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Abstract 

We established in this paper an expHcit connection between passivity-based cooperative control problems and 
the classical network optimization framework. A main contribution of this work is to reveal that duality relations 
known in network theory translate directly to the cooperative control setting. We study a general cooperative 
control problem involving passive dynamical systems and show that the asymptotic configuration is optimal with 
respect to a pair of dual optimization problems, an optimal potential and an optimal flow problem, defined by 
the equilibrium input-to-output maps of the dynamical systems and the nonlinear coupling functions, respectively. 
This connection provides a powerful methodology to analyze more complex problems. We then proceed to study a 
cooperative control problem with saturated coupling functions that exhibits partial output agreement, or clustering, 
in its asymptotic behavior This clustering phenomenon is then interpreted and analyzed in the context of the network 
optimization framework. The novel connection between cooperative control and network optimization provides a 
unifying framework for network analysis and feedback design. We illustrate the potential of the results on a traffic 
dynamics model. 

Index Terms 

Network theory; passivity; cooperative control; convex optimization; duaUty. 

I. Introduction 

One of the most profound concepts in mathematics is the notion of duality. In many ways, duality 
theory is the mathematical answer to the idiom "there are two sides to every coin." This powerful concept 
manifests itself across many mathematical disciplines, but perhaps the most elegant and complete notion of 
duality is the celebrated Lagrange duality in convex optimization theory [HI. Every optimization problem 
admits a dual problem, which provides (under some constraint qualification) the optimal value of the 
original problem, referred to as the primal problem. In addition to its analytic elegance, duality has a 
significant practical relevance, as it has led to efficient numerical algorithms and insightful interpretations, 
both geometric and economic. 

One of the most complete expositions on duality theory relate to a class of optimization problems 
over networks, generally known as network optimization [2J. Network optimization is a sub-discipline of 
optimization theory that integrates aspects of convex and combinatorial optimization theory f2l, [l3l|. Most 
works in this area take an algorithmic perspective and aim to provide efficient computational methods (Si. 
However, in [2], a unifying network theory, based on convex optimization and duality was established. 
The key element of this framework built upon a pair of dual optimization problems: the optimal network 
flow problem and the optimal potential problem. In optimal flow problems, flows are assigned optimally 
to the edges of a network, while in optimal potential problems, potentials on the nodes and tensions along 
the edges are selected in an optimal manner. 

The notion of duality also has a long history within the theory of control systems. Often control problems 
can be formulated as optimization problems and their respective duals have again a controls interpretation, 
see e.g. H. A natural and intuitive notion of duality in control system relates to the concepts of control 
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and estimation, realized through system inputs and outputs. It comes as no surprise that much of the 
duality theory found in controls is a result of the intimate role optimization plays for both the design and 
analysis of these systems. 

A recent trend in modern control theory is the study of cooperative control problems amongst groups 
of dynamical systems that interact over an information exchange network. A fundamental goal for the 
analysis of these systems is to reveal the interplay between properties of the individual dynamic agents, the 
underlying network topology, and the interaction protocols that influence the functionality of the overall 
system [5l, fSl]. Amongst the numerous control theoretic approaches being pursued to define a general 
theory for networks of dynamical systems, passivity [7J takes an outstanding role; see e.g., (HI. In BH, a 
passivity based framework for group coordination problems was established. Passivity was used in [[TOll 
to derive performance bounds on the input/output behavior of consensus-type networks. Passivity is also 
widely used in coordinated control of robotic systems [11 J and the teleoperation of UAV swarms (TT\. 
Passivity-based cooperative control with quantized measurements is studied in [fT3|. The refined concept of 
incremental passivity provides a framework to study various synchronization problems lfT4l . [fT5l . Passivity 
was also used in the context of Port-Hamiltonian systems on graphs, to establish a unifying framework for 
a variety of networked dynamical system in [16|. In a previous work, we used a passivity-like framework 
to study clustering in networks of heterogeneous scalar dynamical systems with saturated couplings [fTTll . 

ttn, m. 

The passivity-based cooperative control framework has many modeling similarities to the network 
optimization framework. Indeed, both classes of problems depend fundamentally on an underlying network. 
A natural question, therefore, is the following: Does the cooperative control framework inherit any of the 
duality results found in network optimization! This question forms the main thesis of this work, and in 
fact leads to a novel and deep notion of duality for networked dynamic systems and an analytic bridge 
between cooperative control problems and network optimization theory. 

In this work, we build on the results of passivity-based cooperative control and establish a connection 
to the general network optimization theory of 

The control theoretic framework that will allow us to establish this connection is the concept of 
equilibrium independent passivity (EIP) [|20l . [|2T]| . Equilibrium independent passivity generalizes the 
classical passivity concept for dynamical systems that admit different equilibria for different constant 
input signals. We consider here a general cooperative control framework where the nodes of the network 
are each EIP systems. As a first contribution, we show that constraints on the control inputs, imposed 
by the network structure of the cooperative control problem, leads to a connection between the control 
problem and the dual pair of optimization problems, i.e., the optimal flow and the optimal potential 
problem. Thus, we provide an interpretation of the inputs and outputs as a pair of dual variables, namely 
as divergences and potentials, respectively. Next, we consider a class of dynamic feedback control laws, 
based upon an internal model approach [|22l . that achieve output agreement. We show that the outputs and 
the states of the controller can also be interpreted as dual variables, namely as flows and tensions, from a 
dual pair of network optimization problems. These results provide us with a complete interpretation of the 
dynamic variables in a network theoretic sense. We show that the duality relation between the different 
variables, and in particular the conversion formula relating these variables, leads directly to a Lyapunov 
function for the closed-loop systems. 

The duality relationships and the network theoretic interpretation provide a powerful framework to 
consider more complex structures and set-ups. One important connection established here is between 
network flow problems with capacity constraints and dynamical networks with bounded coupling functions, 
exhibiting clustering (or partial output agreement) behavior. The network theoretic interpretation provides 
tools to predict the clustering behavior. We illustrate the applicability and relevance of our results on an 
example problem. We discuss how a traffic dynamics model can be understood within our framework and 
use the proposed optimization methods to analyze its behavior. 

The reminder of the paper is organized as follows. We introduce the general network theory, following 
the presentation given in O, in Section |ll} Next, we prepare the control problem by reviewing equilibrium 
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independent passivity in Section III 
is established in Section ITV 



The connection between cooperative control and network theory 
We first discuss the implications of the structural control constraints on 
the asymptotic behavior of the dynamic system. Next, we present and analyze an internal model based 
control law and provide a Lyapunov-based stability analysis. Finally, we highlight the connection between 
constrained network flow problems and cooperative control problems with saturated couplings in Section 
Vj The example problem is studied in Section VI before some concluding remarks are given in Section 

vm 



Notation: Monotone and Convex Functions 

We briefly recall some notions of monotonicity and convexity. A function : M" i— M" is said to 
be strongly monotone on V if there exists a > such that (0(77) — (t>{C)Y — — '^11'? ~ for all 
77, ^ eV, and '^-co-coercive on V if there exists 7 > such that 

{<p{v)-mY{v-i)>i\\m-mr 

for all 1],^ E V, see, e.g., [|23ll . A function $ : M"^ 1— )■ M is said to be convex on a convex set V if for 
any two points t],^ eV and for all A G [0, 1], <I>(A?7 + (1 - A)^ < A<l>(?7) + (1 - A)$(0. It is said to 
be strictly convex if the inequality holds strictly and strongly convex on T) if there exists a > such that 
for any two points 77, ^ ^ with i] ^ ^, and for all A G [0, 1] 

$(Ar^ + (1 - A)0 < A<l>(r^) + (1 - A)$(0 - ^A(l - A)a||r/ - • 

The integral of a function : "D 1— )■ M at the point t] E V is defined as $(77) = (f){s)ds + c, for a 
fixed f] E V and a constant c G M. If is monotone, its integral $ is convex. Similarly, if is strongly 
monotone, its integral $ is strongly convex. 

The convex conjugate of a convex function $(77), denoted $*, is defined as ll24ll 

= sup{77^^ - $(77)} = - inf {$(77) - r]^^}. 

Let be an invertible monotone function and let $ and $* be its integral and the corresponding convex 
conjugate, then V$*(0 = 0^^(00 see e.g., 

A special convex function we will frequently use is the indicator function. Let C be a closed, convex 
set, the indicator function is defined as 

^civ)-'^^^ if7)^C. 
We will also use the indicator function for points, e.g., Io{ri) as the indicator function for rj = 0. 



II. Network Theory 

The objective of this paper is to study passivity-based cooperative control in the context of network 
theory [2J. A network is described by a graph Q = (V,E), consisting of a finite set of nodes, V = 
{fi, . . . ,f|v|}» and a finite set of edges, E = {ei, . . . ,e|E|}, describing the incidence relation between 
pairs of nodes. Although we consider Q in the cooperative control problem as an undirected graph, we 
assign to each edge an arbitrary orientation. The notation Cfc = (fj, f^) G E C V x V indicates that Vi 
is the initial node of edge and Vj is the terminal node. We will abbreviate this notation simply with 
k = and write A; G E and i,j E V. 

The incidence matrix E E rI^I^I^I of the graph Q with arbitrary orientation, is a {0, ±1} matrix with 
the rows and columns indexed by the nodes and edges of Q such that [E]ik has value '+1' if node i is the 

'This correspondence can be generalized to all monotonic functions. The exact statement can be found in |24 Cor. 23.5.1]: If $ is a 
proper convex function, then 77 G 9'1?*(0 if only if ^ G d^ijf), where d^ijj) denotes the set of subgradients of "l? at the point 77. 
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initial node of edge k, '-1' if it is the terminal node, and '0' otherwise. This definition implies that for 
any graph, = 0, where 1 e M'^' is the vector of all ones. We refer sometimes to the flow space of Q 
as the null space J\f(E"^), and the cut space of Q as the range space TZ{E); see [25|. Additionally, ^{E) 
is named the circulation space of Q, and Tl(E^) the difl'erential space. Note that by the fundamental 
theorem of linear algebra, the flow space is orthogonal to the cut space, i.e., J\f{E^) ± TZ{E), and the 
circulation space is orthogonal to the differential space, i.e., J^{E) ± TZ(E^) [|26l . 

The special structure of the incidence matrix makes it an appealing operator to model many physical 
processes including transportation networks and passive electrical circuit theory. This has led to an adoption 
of the vocabulary for these systems into the description of network optimization problems [2J, and we 
rely on this language as well. We call a vector |i = . . . , |J.|e|]^ G I^'^' ^ flow of the network Q. An 
element of this vector, is the flux of the edge k EE. An intuitive interpretation for the flux of edge 
k relates to transportation networks where it represents the amount of material transported across that 
edge. The incidence matrix can be used to describe a type of conservation relationship between the flow 
of the network along the edges and the net in-flow (or out-flow) at each node in the network, termed 
the divergence of the network Q. The relationship states that the net flux entering a node must be equal 
to the net flux leaving the node. The divergence associated with the flow |i is denoted by the vector 
u = [ui, . . . , U|v|]^ G M'^' and can be represented a^ 

u + E[L = 0. (1) 

Borrowing from electrical circuit theory, we call the vector y G M'^' a potential of the network Q. An 
element of this vector, y^, is called the potential at node i. For any edge k = one can associate the 

potential difference across the edge as C,k = Jj — Ji] we also call this the tension of the edge A;|^ The 
tension vector of the network G, C,= [^i, . . . , C|e|]^, can be expressed a^ 

^ = ^^y. (2) 

Rows and tensions are thus related to potentials and divergences by the conversion formula 

^l^C = -y^u. (3) 

Network theory broadly connects elements of graph theory to a family of convex optimization problems. 
The beauty of this theory is that it admits elegant and simple duality relations, as it relates a dual pair of 
optimization problems: the optimal flow problem and the optimal potential problem. 

The first problem attempts to optimize the flow and divergence in a network subject to the conservation 
constraint (|lj). Each edge is assigned a flux cost, Cl''^^{[lk), and each node is assigned a divergence cost 
Cf^{ui). The optimal flow problem is then 

inin + (4) 

s.t. u + = 0. 

The optimization problem (|4]) admits a dual problem with a very characteristic structure. To form the 
dual problem, one can replace the divergence Uj and flow variables in the objective functions with 
artificial variables Uj and p.^, respectively, and introduce the artificial constraints Uj = Uj, = p,fc. These 
artificial constraints can be dualized with Lagrange multipliers ji and C,^, respectively. The objective 
functions of the dual problem turn out to be the convex conjugates of the original cost functions, i.e.. 



^This condition is Kirchhojf's Current Law. 

^In tliis case, the nodes can be tliought to represent force. 

''Thiis condition is Kirchoff's Voltage Law 
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and 

As in the dual, the linear constraint of the form ^ = E^y must hold, where y = [yi, . . . ,y|v|]^ and 

^ = [^1, . . . , ^|E|]^; it follows that ji dire, node potentials and are the edge tensions. The dual problem 
to (|4]) is now called the optimal potential problem 

|V| |E| 

min j]cr(y.)+5^cr(c.), 

^'^ i=l k=l ^ ' 

s.t. ^ = E'^y. 

We provide in the sequel an interpretation of a cooperative control problem for a certain class of passive 
dynamical systems in the context of the network theory and present several duality relations. 

III. Equilibrium Independent Passivity 

The main objective of this paper is to connect a cooperative control problem for a class of passive system 
to the general network theory introduced in Section |llj The right systems theoretic framework to establish 
such a connection turns out to be equilibrium-independent passivity (EIP), as recently introduced by Hines 
et. al. Il20|| . Equilibrium independent passivity specializes the classical passivity concept to systems whose 
equilibrium point depends on an external signal. This framework can be traced back to earlier works 
including [21 J. We review the concept of EIP and some results from [|20ll . but restrict the discussion here 
to SISO systems. 

Consider a nonlinear dynamical control system of the form 

x{t) = f{x{t),u{t)), y{t) = h{x{t),uit)), (6) 

with state vector x{t) e X C Rp, and u(t) e U C R, y(t) e y <^ R. The system ^ is said to have 
an equilibrium input-to-state characteristic if there is a set W C W such that for every u E U there 
is a unique x E X satisfying /(x, u) = 0. The equilibrium input-to-state map : U X (1 X is 
defined accordingly by /(A;x(u),u) = 0. We assume throughout the paper that /Cx is continuous on U. The 
corresponding equilibrium input-to-output map is defined as ky : U t-^ y C y with ky := h{kx{n),u). As 
a notational convention, we will use italic letters for dynamic variables, e.g., x{t), and letters in normal 
font for constant signals, such as, e.g., x. 

Definition 3.1 ([20]): The system (|6]) is equilibrium independent passive (EIP) on U if for every u eU 
there exists a once differentiable and positive definite storage function : ^ ^-t- M such that 5'u(x) = 
S^{k^{u)) = and 

S^{xit),u{t)) = VSj{xit))fixit),uit)) < -u)(y(t) -y) (7) 
where x = k^{u) and y = A;y(u)j^ 

Note that Su{x{t)) is defined for a given equilibrium input u E U, and it is required that there exists a 
storage function S^{x(t)) for all u eU. We will not distinguish the storage functions defined for different 
constant input signals in the following and simply write S{x). 

Definition 3.2 ([20]): The system (|6]) is output strictly equilibrium independent passive (OSEIP) if 

S{x{t),u{t)) < {u{t) - n){yit) - y) - p{y{t) - y) (8) 

for some positive definite function p(-). 

It was shown in [|20l that the equilibrium input-output map of an OSEIP system is co-coercive. We 
provide the result here from a slightly different perspective, involving the inverse of the input-to-output 
map; it follows from an observation about co-coercive functions given in [i23il . 

^Throughout the paper the gradient of a function is defined as a column vector VS = (§f 
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Lemma 3.3 (Strong Monotonicity): If ([6]) is OSEIP with p{y{t) — y) = l\\y{t) — y||^ and ky{u) is 
invertible on U, then the inverse /c" ^(y) is strongly monotone on y. 

Proof: The dissipation inequality ([8]) with p(y(t)—j) = 7||y(i) — y|P must hold for any trajectory and 
in particular for any other equilibrium trajectory u{t) = u' (with y(t) = y', x{t) = x' defined accordingly), 
giving V5^(x')/(x',u') < -7||y'-yf + (y'-y)(u'-u). Using /(x',u') = and replacing u' = k-\j') 
(u = k^^{j)) we obtain the strong monotonicity condition 7||y' — yp < (y' — y)(^y ""^(y') — ""^(y))- ■ 

EIP is clearly a stronger requirement than classical passivity. However, it can be established for various 
important problem classes. As discussed in [20|, any incrementally passive system (see, e.g., [|T4ll . [|27ll ') is 
also equilibrium independent passive. The converse, however, is not necessarily true. In [|2T|, conditions 
for EIP of nonlinear systems with constant input vector fields are presented. 

In this work we are interested in systems with "global" input-to-output maps, having W = M and ^ = M. 
We point out two important system classes that admit globally defined equilibrium input-to-output maps 
and are OSEIP. We are particularly interested in systems with A;y(0) ^ 0, which motivates the following 
examples. 

Example 3.4 (Affine Systems): Consider the affine system of the form 

x{t) = Ax{t) + Bu{t) + w 
y{t) = Cxit) + Du{t) + v 

with (y4, B) controllable and {A, C) observable. The system is OSEIP if [A, B, C, D) satisfy the matrix 
equations of the KYP-lemma ll28ll . (i.e., the system is strictly output passive in the classical sense) and A 
is invertible [20 1. In addition, with w G and v G M being constant signals the equilibrium input-output 
map is the affine function 

ky{\x) = {-CA-^B + D)n+ {-CA'^w + v) , (9) 

i.e., the dc-gain of the linear system plus the constant value determined by the exogenous inputs. 
Example 3.5 (Scalar Systems): Consider the scalar nonlinear system 

x{t) = -f{x{t)) + n(t), y{t) = x{t), (10) 

with x{t) G M,M(t) G M,?/(t) G M. The system is OSEIP if ^ satisfies the QUAD condition, see [|29l . 
i.e., for all x'{t) and x"{t) it holds that 

{x\t) - x"{t)){f{x'{t)) - f{x"{t))) > 7(x'(t) - x"{t)r. 

Systems of this form are considered in the context of synchronization [fTSl . [|29l , [|30ll . Note that the 



QUAD condition reduces for the scalar system ( fTO] ) to a strong monotonicity condition on f{x{t)). The 



dynamics can then be understood as the gradient of a strongly convex function, i.e., f{x{t)) = VF{x{t)). 
This corresponds to the system class studied in fifTll . [fT8l , [[3T| . The equilibrium input-output map is then 
the strongly monotone function A:y(u) = /"^(u). 



IV. Output- Agreement and Network Theory 

We turn our attention now to a multi-agent cooperative control problem. In this section, we will explore 
the output agreement problem for a team of agents that are each passive systems. We connect this 
dynamical control problem to the network theory framework of L2J, and point out several duality relations 
between the involved variables. 

We consider a network Q = (V, E) of dynamical systems, with each node of Q representing an output 
strictly equilibrium independent passive SISO system 

^i- Xi(t) = /i(xi(t),u,(t)), y^{t) = hi{x^{t),Ui{t)), ieV. (11) 

The OSEIP property implies that for each Uj G a storage function exists. We assume, in order to 
avoid misleading technical discussions, that the storage functions Si(^Xi{t)) are positive definite. We focus 
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on networks comprised of heterogeneous systems, and in particular for networks where the uncoupled 
systems have inherently dijferent unforced equilibria. Equivalently, each agent has a different equilibrium 
input-to-output map when there is no forcing term, i.e., 

KA^) 7^ K,M for all id e V. (12) 

In the following we adopt the notation y{t) = . . . ,y\v\{t)Y and u{t) = ['Ui(t), . . . ,u\y\{t)Y for the 

stacked output and input vectors of the complete network. We use normal font letters y, u to indicate that 
a vector corresponds to equilibrium trajectories. Similarly, we use ky(u) = [/cy i(ui), . . . , /Cy |v|(u|v|)]^- 
If all ky^i are invertible, we write ^(y) = [A;yj(yi), . . . , A;-;^(y|v|)]^. 

We want the systems to reach an agreement on a constant steady-state value of the outputs. 

Definition 4.1: A network of dynamical systems ( [TT] ) is said to reach output agreement if 

lim y{t) (31 (13) 

t—^oo 

for some /3 G M, called the agreement value. 

Output agreement should be achieved through a coupling of the network nodes using the control inputs. 
The cooperative control framework we consider is based on a canonical control structure, illustrated in 
Figure [1] |9|. The controllers 11^ are located between neighboring systems in the network and use the 
relative outputs of the systems i.e., C(t) = y(t), as their inputs. This immediately implies that the 
couplings between neighboring systems are dijfusive couplings [[22|. As we consider the underlying graph 
to be undirected, we focus on symmetric couplings, where the output of a controller influences the two 
incident systems with reversed signs. Following the network interpretation, the control input u{t) is 
generated by the mapping of the controller outputs, denoted by /x(t), through the incidence matrix E 
to the nodes of the system. This structure has evolved as a standard control structure in passivity-based 
cooperative control, see e.g. [[H, ||9l, [|T6l . and is the basis for our work here. Later, we will specify our 
particular choice of the controllers 11^. 

We now make the following observation resulting from the network structure of the control system. 
The control input u(t) is always in the cut-space of Q, that is 

u{t) e n{E). (14) 

This structural condition is independent of the exact controller we choose, but is purely a consequence of 
the networked structure of Figure [T| A direct consequence of this structural condition is that the control 
inputs summed over all nodes in the network will vanish, i.e., l7 u{t) = 0. Before we propose a feedback 
control law for output agreement, we first investigate the role of the structural constraint u(t) E TliE) 
in the agreement problem. This also motivates the general organization of this section, whereby we first 
consider the network implications for output agreement at the plant level, and then perform a similar 
analysis at the control level, and conclude by analyzing the complete closed-loop system. 



A. The Plant Level 

Without specifying a control law, we first investigate the output agreement problem considering only the 



plant dynamics ( [TT] ) and the structural constraint on the input ( fT4| ). This discussion will already provide 
us the first duality relation in passivity-based cooperative control. 

We note directly that the dynamical network ( [TT] ) has an agreement steady-state y = /31 if and only if 
there exists an equilibrium control input u G T^iE) such that ky(u) G span{l}. The algebraic constraint 
u G Tl{E) contributes to the structure of the coupling controller, while the second condition ensures 
the existence of a steady-state output in agreement, since y = ky(u). Note that span{l} = J\f{E~^). A 
stronger, more insightful, characterization of the agreement steady-state can be established under some 
additional assumptions. 

Assumption 4.2: All node dynamics ( [TT] ) are OSEIP with U = M. and y = 
input-to-output maps /Cy j(uj) of all systems ([TT]) are invertible and strongly monotone. 



and all equilibrium 
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Fig. 1. Block-diagram of the canonical passivity-based cooperative control structure. 



The affine systems of Example |X4 and the gradient systems of Example |33 satisfy this assumption. 



Under this assumption the agreement steady-state can be precisely characterized. 



Lemma 4.3: Let Assumption 4.2 hold. Then there is a unique agreement steady-state y = /51 and the 
agreement value (3 satisfies 

|V| 

i=l 

Proof: The condition of a steady-state is ky(u) = Since, by assumption, all input-output 
characteristics are invertible, we have u = Since u G 1Z{E), it must hold that u is orthogonal 

to Af{E'^). Since Af{E'^) = span{l}, it follows that l^u = l'^ky^(/31) = 0. By assumption, the 
input-to-output maps are strongly monotone implying that there always exists exactly one (3 such that 

iX"^(/3i) = ESfc-!(/3) = o. ■ 

This small observation leads us to a novel interpretation of the output agreement problem in the context 
of network theory studied in [2J. We define for each node the integral function of the equilibrium input- 
to-output map ky^i{ui), denoted Ki{ui), and satisfying 

Vu,K,{ui) = k^M)- (15) 

As ky^i is co-coercive, the integral function Ki is convex. We will call Kiivn) in the following the cost 
function of node i. The convex conjugate of the cost function Ki{ni) is 

K^i(y.^ = sup {yiUi - Kiim)}, (16) 

and is called the potential function of node i. Recall that VyK*(yi) = k^liji). 

We now connect the steady- state agreement output of the dynamical network with a distributed, 
symmetric feedback, i.e., u(t) E TZ{E), to the dual pair of network optimization problems. 
Optimal Potential Problem: Consider the static optimal potential problem of the form 

|V| 

min y^if*(yj), 
y, ^ (OPPl) 

s.t. E'^y = 0. 

The objective functions of this problem are the convex conjugates of the integral functions of the 
equilibrium input-to-output maps. The constraint E^y = enforces a balancing of the potentials, i.e., 
yi = ■ ■ ■ = y| v| • Note that the problem can be written in the standard form of an optimal potential 
problem (|5]), with Cf°*(yj) := K*{Yi) and C*'^"(^fc) the indicator function Io{^k) for the point zero. In 
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fact, we now establish that the steady- state agreement output of the network of dynamical systems (fTTl) 



corresponds to the optimal potentials computed with (jOPPTj). 
Theorem 4.4 



/31 be the agreement state of the network (11) 



Let Assumptions 4.2 hold, and let y 
Then y is the optimal solution to ( QPP1[ ). 

Proof: Under the stated assumptions. Lemma |43 shows that an agreement steady-state exists with 
y = /31 and that the agreement value /3 satisfies Yl^^JiK\i.P) = 0- particular, we have 



|V| |V| 



i=l 



i=l 



This is the first-order optimality condition of (QPPl I after replacing the constraint _E y = with the 



equivalent condition y = Therefore, y = /31 is an optimal solution to ( |0PP1[ ). ■ 
This observation leads directly to an interpretation of the systems outputs y{t) as potentials in a network 
theoretic sense. Somehow surprising, the steady-state control input generating this agreement output is 
directly related to the dual problem of ( |QPP1[ ). 

Optimal Flow Problem: The dual problem to (|QPP1[) can be derived in the standard way as outlined in 



Section |llj One obtains the dual cost functions as the convex conjugates of the original cost functions. 



i.e., Kt 



Ki and Iq = 0, leading directly to the optimal flow problem 



|v| 

i=l 

S.t. u + E\i = 0, 



mm 

U,)I 



(OFPl) 



with divergence variables u G M'^' and flow variables |i G M'^L This is precisely an optimal flow problem 
of the structure given in (|4]). Please note that u refers at this point only to the divergence variable of the 
network optimization problem. However, as suggested by the notation, we will connect the divergence 
variable to the control inputs. A first observation in this direction is that the equality constraint u + E\x = 
incorporates directly the structural condition u G 1Z{E). In fact, the solution to ( |QFP1[ ) is exactly the 
steady-state input required for output agreement. 



Theorem 4.5: Let Assumptions 4.2 hold and let y = /31 be the agreement state of the network ( [TT| ). 
Then the u satisfying ky(u) = y is an optimal solution to ( |0FP1[ ). 



Proof: Consider the Karush-Kuhn-Tucker conditions of optimality of (jOFPTj) [1], with y being the 
Lagrange multiplier to the equality constraint, i.e., V-ft'j(u) — y = 0, E = 0, and u + E\Ji = 0. The first 
condition is equivalent ky(u) = y and the second condition implies y = al. Thus, combining the second 
and the third condition, we obtain y^u = 0, i.e., «Xll=i = 0- This is equivalent to X]!=i ^yliji) = 0- 
Thus, the Lagrange multiplier y is the agreement steady state output. Additionally, the corresponding 
steady-state input u satisfies the KKT condition ky(u) = y, and is therefore an optimal solution to 
dOFPT] ). ■ 
Thus, we can interpret the input of the dynamical network u(t) as a divergence in the network theoretic 
sense. Additionally, we have established an interpretation of the outputs y(t) as potential variables. As the 
divergence and potential variables are a pair of primal/dual variables, this observation provides us with a 
first duality relation between the inputs u(t) and the outputs y{t) of the dynamical network ( [TT] ). In this 
context, we find that this duality is actually precisely explained via the two dual optimization problems 
listed above. This duality interpretation can be extended further when considering the conversion formula 
(|3]) that states \x^C, = — y^u. For the problem (OPPl), the edge tensions are fixed to be zero, which in 



turn forces the solution to its special structure in span{l}. The conversion formula then immediately 
yields that y^u = 0. Please note that the conversion formula holds in particular also for the dynamic 
variables. It is straight forward to see that fi^(t)(^(t) = —y^(t)u{t). However, the connection to the 
network optimization problems holds only for the asymptotic behavior of the dynamic variables. 
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We have analyzed the properties of the agreement steady-state solution for the dynamical network ( [TT] ) 
under the structural condition on the control input, i.e., u{t) E 1Z{E). While this discussion provides a 
clear interpretation of the potential and tension variables, as well as the divergence variables, it left some 
freedom in the definition of the flow variables. In fact, it is remarkable that the edge flow variables |i in 
( |0FP1[ ) are neither constrained nor penalized by any cost function. Problem ( |0FP1[ ) does not determine 
the flows uniquely, as any feasible flow |J, can be varied in J\f(E), i.e., the circulation space of Q, see 
[El, [l25ll . If Q contains cycles, then there is a continuum of edge flows corresponding to u. We 
will call in the following all |l which correspond to an optimal solution of ( |QFP1| ) the feasible flows. 
However, the conservation constraint u = —E\x indicates already that the flow variables are important 
for the computation of the steady-state control input. In fact, the flows will be determined by the control 
structure, which is chosen to regulate the network to output agreement. 



B. The Control Level 



We now close the loop and present a distributed control scheme that ensures the dynamical network 
reaches output agreement. We focus on controls in the generic structure illustrated in Figure [T] and now 
define the dynamical systems 11^. 

To begin, note that any static diffusive coupling, using only the current relative measurement, i.e., 
{yi(t)—yj{t)), vanishes as an agreement state is reached. Consequently, for systems with different unforced 



equilibria, i.e., condition ( [12] ), output synchronization cannot be achieved using only static couplings. As 
a direct consequence of the internal model for synchronization [[22|[. [[32l . we consider dynamic couplings 
and use an integrator as common internal model for the entire network with the form 

: Vkit) ■■= I {yj{T) -yi{T))dT, fik{t) = tpkiVkit)) (17) 

J to 

where the edge k is incident to the nodes i and j. The function T/^fc : M i— > M is a coupling nonlinearity 
which, similar to ^,is assumed to be the gradient of some convex, differentiable function P/,- : i— )■ ]R>o, 
attaining a minimum at the origin, i.e., 

MVkit)) ■■= VPkivkit)). (18) 
The control input applied to the plants is computed according to the structure of Figure [T] as 

u{t) = -E^{t). 

In summary, the dynamic coupling control law can be represented as 

fiit)=E^yit), r}ito)eniE^), 
u{t) = -Etl^iriit)), 



(19) 



where r}{t) = [r]i{t), . . . , ?7|e|(^)]^ is the controller state and the controller output is denoted as 'ip{rj{t)) = 
[^i(?7i(t)), . . . ,^|E|(^|E|(t))]^- Please note that r]{t) E TZ{E^) and u{t) E Tl{E) for aU times. We leave 
here some degree of freedom on the nonlinear output functions of the controller. However, for the remainder 
of this section, we will restrict our attention to the following class of functions. 

Assumption 4.6: The functions PkiVkii)) are twice differentiable, even, and strongly convex on M for 
all A; e E. 

To start the analysis of the coupling controller ([19]), we first have to show that it is able to generate the 
steady-state control input, i.e., u, which leads to complete output agreement. Recall that the steady-state 



control input leading to output agreement is the solution to ( ]QFP1] ). We exploit an interpretation of the 
controller variables in a network theory framework to show that the internal model controller ( [T9] ) can 
generate the correct steady-state input. 
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Optimal Potential Problem: We assume in the following that u = 
Consider now the following optimization problem 

|V| |E| 

min V'ujVj + y^Pfc(rifc), 

1=1 fc=l 

s.t. ri = £'^v. 



[ui, . . . , U|v|] is a solution to ( |QFP1| ). 



(0PP2) 



Problem ( |QPP2[ ) satisfies the structure of the optimal potential problem given in ([5]). The variables 
V = [vi, . . . , V|v|]^ are node potentials and are associated to a linear cost function. The variables 
T] = [rii, . . . ,t1|e]^ are tensions along the edges and are associated to the objective functions P^, which 
are the integral functions of the coupling nonlinearities. The next result shows that the optimal solution 



to ( |QPP2[ ) directly defines the steady-state value of the internal variable r]{t) of the dynamic controller 



(19), which is necessary for output agreement. 



Theorem 4.7: Let Assumptions 4.6 hold and let u be the solution to ( |0FP1[ ). Then, the solution (v,ri) 
to ( I0PP2D is such that Tj G 7^(E^) and u = -^^'(ri). 

Proof: We use the following short-hand notation P(ti) 
strongly convex functions and are globally defined. Thus, the optimization problem ( |QPP2| ) has a finite 
optimal solution. From the Lagrangian 



lEl 

Yjk=\Pk{y\k) ■ By assumption, all are 



£(ri, V, ^i) = P(ri) + u^v + |iT(-ri + ^^v) 



(20) 



with Lagrangian-multiplier |i G M'^', the optimality conditions can be derived as VP(ri) — |j, = 0, 
E^\Ji + u = 0, and r\ = E^\. From the last condition follows that any optimal T] satisfies T] G Tl{E^). 
Furthermore, the first two conditions can be combined, providing u = —E'VP{r\) := —Eil}(r\). ■ 



Please note that although ( |QPP2[ ) is an optimal potential problem, it is not directly connected to the 
problem (|QPP1[), which was associated to the outputs of the dynamical system. Instead, (|0PP2[) is an 



additional optimal potential problem, which describes the steady-state behavior of the internal model 



controller (19). We conclude with the observation that the internal model controller (19) can, in fact. 



generate the desired steady-state output. 

Naturally, the dual problem to the potential problem ( |QPP2[ ) is again a flow problem. This dual problem 
is related to the output of the internal model controller, and will provide us with the missing interpretation 
of the network flow variables. 

Optimal Flow Problem: The dual problem to ( |QPP2[ ) can be derived directly from the Lagrangian 
(|20|). Standard calculations lead to the following optimal flow problem 



|E| 

min y"Pfc(|lfc) 



k=l 



(0FP2) 



s.t. u + E\x = 0. 



Please note that in this problem, u is not a decision variable, but the solution previously defined by 
( |0FP1[ ). However, the problem is in compliance with the standard form of optimal flow problems (|4]), as 
one can simply introduce artificial divergence variables and add as a cost function the indicator function 
for the point u. 

Note that any flow |i which is feasible for ( |QFP2| ), is also a feasible flow for our first optimal flow 
problem ( |0FP1[ ), since u is by assumption an optimal solution to ( |0FP1[ ). We can see therefore, that the 
new flow problem ( |QFP2[ ) selects from all feasible flows the one that minimizes the flow cost, defined 
by the convex conjugates of the integral functions of the coupling nonlinearities. 

To complete the connection between the dynamic variables of the control systems and the network theory 
variables, we now formalize the connection between the optimal flow and the output of the internal model 
controller. 
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Theorem 4.8: Let Assumptions hold, and let r\ be an optimal solution to ( |QPP2[ ). Then the optimal 
solution |i to (|QFP2[) satisfies |i = ^(il)- 



Proof: We use again the short-hand notation P*(|l) = X]fc=i -^fc (M-fe)- Consider the Lagrangian of 



(0FP2) 



£(Ai,v) = P*(^)+vT(-u-i5;^) 
with Lagrange multiplier v. The conditions of optimality are V^P*(|J.) = E^v and u + E\x = 0. As by 



assumption all the functions Pk are strongly convex, their gradients are invertible, and VP^ 



Thus, the first optimality condition implies that |i = VP(-E' v). We can define now r\ = E v. To 
complete the proof, it remains to show that r\ is an optimal solution to ( |QPP2[ ). We have from the second 
optimality condition that u + EVP{r\) = 0. Thus, r\ satisfies all optimality conditions of ( |0PP2[ ), which 
proves the theorem. ■ 

We have now a second duality relation in the passivity -based cooperative control framework. The internal 
state of the controller ( flQ] ), r](t), can be understood as a tension, while the output of the controller, i-i{t), 
can be understood as the corresponding dual flow variable. 

We want to emphasize again that we identified network optimization problems on two different levels 
of the cooperative control problem. First, at the plant level, the dual problems ( |0PP1[ ) and ( |0FP1| ) 
characterize the properties of the agreement state. The problems are fully determined by the properties 



of the dynamical systems ( [TT] ) and the topology of the network Q. Second, another dual pair of network 



optimization problems, i.e., ( |0PP2| ) and ( |QFP2[ ), is associated to the internal model controller ( [T9| ), used to 
achieve output synchronization. These problems depend on the chosen control structure, i.e., the coupling 
nonlinearities, as well as on the solution to ( |QFP1[ ). Thus, the two levels are not completely independent, 
but the plant level problems influence the problems on the control level. 

C. The Closed-Loop Perspective 

It remains to analyze the behavior of the closed-loop dynamical system. We exploit the conversion 
formula Q, i.e., \xJC, = — y^u, to construct a Lyapunov function. We first note that the conversion 
formula also holds for the dynamic variables, i.e., n^{t)Cit) = —y^{t)u(t). The right hand side of this 
dynamic conversion formula is reminiscent of a supply function for passive dynamical systems. A natural 
question to ask in the context of this paper is what the conversion formula looks like for the supply 
function {y{t) — y)^('u(t) — u). Exploiting the previously established connections, we make the following 
considerations 



u 



-y^{t)E{fi{t)-^)-y^{u{t) 
-^T(t)fvP(r7(t))-VP(ri) 



u 



u 



(21) 



yT(it(t)-u) 



Observe that in this particular problem we have y G span{l} and u(t), u G TZ{E). Therefore, (u(t) — 
u) = 0. We conclude that 



(22) 



(vP(77(t)) - VP(ri))^r;(t) = -{y{t) - {u{t) - u). 

The last equation has the flavor of a dissipation equality. In fact, a storage function corresponding to ([22]) 
is 

Bp(77(t),Ti) = P(r7(t)) - P(Ti) - VP(ri)^(77(t) - ri). (23) 
Note that ([23]) is the Bregman distance, see [33], associated with P between 77 (t) and r\ . The function 



Bp{r){t),r\) is positive definite and radially unbounded since P(-) is a strictly convex function. From ( [22] ) 
it follows now 



Bp(r7(t),Ti) = -(?/(t)-y)T(ii(t)-u). 



(24) 
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We can use these observations now for a Lyapunov analysis of the closed-loop system. 



Theorem 4.9: Consider the network of dynamical systems (11), with the control inputs defined in ( 19) 



Let Assumption 4.2 and Assumption 4.6 hold. Then the network ( [TT| ), ( [17] ) converges to the agreement 
steady-state y = and 



y(a^(t),77(t)) = S(x(t)) + Bp(r7(t),ri) 



(25) 



with S{x{t)) := X]!=i Si{xi{t)) (i.e. the EIP storage functions), is a Lyapunov function for the closed-loop 
system. 

Proof: The Lyapunov function V{x(t),r]{t)) is positive definite since both Si{xi{t)) and Bp(77(t),ri) 
are positive definite. By assumption, all system ( [TT] ) are OSEIP and thus 

|2 



Sixit)) < -7ll2/(t) - y ir + ivit) - y) ' (uit) - u) 



(26) 



Thus, combining ([26]) and ([24]), we obtain the directional derivative of the Lyapunov function candidate 
as 



V{xit),r}it)) = Six{t)) + Bpir^{t),^) < -^\\y(t)-y\ 



(27) 



Since lim^^oo — V^(x(to)) exists and is finite, and since pi are positive definite, we conclude 

from Barbalat's lemma [[28]| that limt^oo ~ Yill = lii^t-^oo ~ — > 0. Additionally, by the 

invertability of the input-to-output map follows that u{t) converges to u and, consequently, rj(t) converges 
to Tj. ■ 
We can summarize the observations of this section as follows. All signals of the dynamical network 
( [TT] ) and ( ]T9] ) have static counterparts in the network theory framework of Section [11] For example, the 
static counterparts of the outputs y{t) are the optimal solutions y of an optimal potential problem ( jOPPl] ), 
defined by the equilibrium input-to-output map of the dynamical systems. Equivalently, the corresponding 
dual variables, i.e., divergence variables in ( |0FP1[ ), u, are the static counterparts to the control inputs 



u{t). Additionally, the state 77 (t) and the output //(t) of the internal model based controller ( [T9[ ) have the 
tension and flow variables of ( [0PP2[ ) and ( |QFP2] ), respectively, as their static counterparts. We visualize 
the connection between the dynamic variables of the closed-loop system and the static network variables 
in Figure [2] Note that the signals in the dynamical system influence each other in a closed-loop structure. 
However, there is no equivalent closed-loop relation in the connection of the network variables. In 
particular, the two tension variables C, and r\ are not connected, while their dynamic counterparts (^(t) 
and 77 (t) are connected by an integrator. Additionally, a summary of all variables involved in the output 
agreement problem together with their static counterparts and the defining network optimization problems 
is provided in Table |lj For the sake of completeness, we include also the dynamic variable v(t), which 
corresponds to the potential variables v of ( |0PP2] ). Although we did not consider v{t) explicitly in our 
discussion of the dynamical network, we can define it in accordance to ( |QPP2| ) as 77 (t) = Ev(t), and 
obtain a complete connection between the passivity based control problem and the network optimization 
problems dOPPip, dOFPip, (|QPP2D, and (|QFP2D. 



V. Constrained Network Flows & Dynamic Clustering 

A major advantage of the novel interpretation presented above is that it allows us to integrate constraints 
into the setup. A typical limitation appearing in network flow problems are capacity constraints on the 
edges, and we aim here to understand the dynamic counterpart to the cooperative control problem with 
capacity constraints. However, before we turn our attention to the dynamic system we consider first the 
static versions of the network optimization problems with flow constraints and show that a combination 
of the two optimization problems (i.e., optimal flow and optimal potential problem) can provide important 
insights into the solution structure. 
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System Input u{t) 
O 



System Output y{t) 



■ VK(u) 



Divergence u ■ 



■ Potential y 



Controller 
Output fj,{t) 













\ ''•''\E\ 


Controller 





u = 



Relative 
Output Cit) 



Flow \l ■ 



■ Tension T) 



Tension ^ 



H = VP(Ti) 

(b) Variables of the Network Theoretic Framework 



(a) Signals of the Closed-Loop Dynamical System 

Fig. 2. The block diagram of the closed loop system (a) and the abstracted illustration of the network variables (b). Note that the static 
tension variables ^ and T] are not connected, while their dynamic counterparts <^{t) and ri{t) are. 

TABLE I 

Relation between variables involved in the dynamical system and their static counterparts. 



Dynamic Signal 


Network Variable 


Relation 


Cost Function 


Optimization Problem 


y{t) system output 


y potential 


y = ky(u) 


K*{y^) 


OPPl 


<^{t) relative output 


^ tension 






OPPl 


u{t) system input 


u divergence 


u = k-i(y) 


Ki{ui) 


OFPl 


fj,{t) controller output 


|J, flow 


u + E\L = 




OFP2 


v{t) - 


V potential 


Tl = E^v 


UfeVfc 


OPP2 


r]{t) controller state 


T] tension 


[i = ■0(r|) 




OPP2 



A. A Primal/Dual and Saddle-Point Perspective 

We assume in the following that each edge is assigned a capacity of Wk G M>o, and we restrict the 
flows to be contained in the set = {/ifc : —Wk < M-fc < w^}. 

Optimal Flow Problem: Adding the flow constraints leads directly to the network flow problem 

|V| 



mm 

^=1 (0FP3) 
u + E[L = 



To formulate ( |0FP3| ) in the standard form Q, we can add the indicator functions X]fc=i ^w^il^k) for the 



constraint sets Wk in the cost to enforce the constraints. From this standard problem formulation, the 
dual problem can then be derived directly, taking into account that the convex conjugates of the indicator 
functions for the sets are the weighted absolute values, i.e., I^^ = sup{^|J, — Jwfc(M-A;)} = Wk\Ck\- 
Optimal Potential Problem: The dual to the optimal network flow problem ( |QFP3[ ) is then the following 
optimal potential problem 

|V| |E| 

min > KUYi) + > Wk\Ck\ 

y,t; ^ ^\y^)^Z_^ felbfel (0PP3) 
i=l k=l 



Note that adding the capacity constraints allows the tensions ^ in ( |QPP3| ) to be unequal to zero. 
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Going directly to the dual using the convex conjugate representation seems fairly straight forward. 
However, performing this step directly conceals some important insights. In particular, the two optimization 
problems ( |0FP3[ ), ( |0PP3[ ) provide little insights into the structure of the optimal solution. As we might 
believe, after our previous discussion, that the potentials correspond to the asymptotic behavior of a 



cooperative dynamical network, we are interested in the structure of y as computed by ( |QPP3[ ). Since the 



structure of y is not readily seen from ( |0PP3[ ), we consider an additional representation of the network 
optimization problems. In fact, we consider an optimization problem which combines variables of the two 
primal/dual problem representations, i.e., on the one hand potential variables y and on the other hand 
flow variables |i. 

Saddle-Point Problem: We consider now the following saddle-point problem 



max min C{y, |l) : = 



|V| 



|E| 

k=l 



(SPP) 



Theorem 5.1: Let (y,|l) be a saddle-point solution to ( |SPP[ ), then y is an optimal solution to ( |0PP3[ ), 



and |j. is an optimal solution to (0FP3 1. 



Proof: From min-max theory follows directly that a saddle-point solution to ( |SPP[ ) is such that y 
is a minimizer of the function r(y) = max^£(y,|i), and |i is a maximizer of the problem function 
= miny £(y, First, note that we can introduce in ( |SPP[ ) the variable ^ = E^y and obtain 

-E\!i. 



^(y) = EH KtiY.) + max, T:^l,{\ykCk - /w,(^l.)} = Ei:i Ktiy. 
( |QPP3[ ). Alternatively, we could introduce in ( |SPP| ) the variable u 



^|E| 



E 

arg mm. 



1 mmy. 



{Kt{Y^ 



u 



y} 



Y-|E| 



U,; 



-s(|l), the statement follows directly. 



Y-|E| r 



which is exactly 
We obtain then = 



X[^k)- Since argmax,^ s(|l) 



The main advantage of considering the saddle-point problem (SPP) is that it gives us insights into the 



structure of the solutions. In fact, the problem ( |SPP[ ) allows us to connect the discussion presented here to 
the results of [fTTl . [fTSl which showed the solution y to have a clustering structure. An intuitive explanation 
of this result is as follows. If two nodes are connected by an edge for which the corresponding flow satisfies 
the capacity constraints strictly, then the two nodes must have the same potentials. Furthermore, those 
edges for which the flow constraints are active partition the network. This idea is formalized in the 
following theorem from [17J. 

Theorem 5.2 (^7^): Let (y, |J.) be a saddle -point solution of ( |SPP[ ) and let Q C E be the set of the 
edge capacity constraints that are active. Then Q induces a partition P = {Pi, . . . , Pp} of the node set 
and nodes within one partition attain the same potential, i.e., = jj for all i,j E Pi. 

Thus, the saddle-point problem explains a clustering of the node potentials in constrained network flow 
problems. We want to emphasize that the previous works [fTTl . fl8] studied this problem from a purely 
saddle-point optimization perspective, whereas in this work we consider the more general network flow 
interpretation of the problem. 



B. The Dynamical Systems Perspective 



As we are interested in the connection between the cooperative control framework of Section IV and 



the network flow problems ( |QFP3[ ), ( |QPP3[ ), we have to define a controller of the structure ( [T9| ) which is 
in accordance to the new constraints. For this, we have to define suitable coupling nonlinearities. In this 
direction, we consider now a new class of flow cost functions. 

Assumption 5.3: The flow cost functions P^i\i-k) are differentiable, even, convex functions on the convex 
set Wfc = {\Xk '■ —Wk < M-A: < Wk] for some edge capacity Wk > 0, and 



lim P^{[Lk) 



—7- oo. 



We can recall from our previous discussion that the flow cost functions are the convex conjugates of the 
integral functions of the coupling nonlinearities, i.e., -ipkiVk) = VPfc(%)- If Assumption 5.3 holds, the 
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corresponding coupling nonlinearities V^fc(-) are monotone (even co-coercive) and bounded functions, i.e., 
lim||s||^oo ||^fc('5)|| Wk- Thus, capacity constraints in the network flow interpretation correspond directly 
to bounded coupling functions in the cooperative control problem. Examples of coupling nonlinearities 
il)k that are in accordance with Assumption |5.3| are, e.g., saturation functions with saturation level Wk, i.e., 

i)k = satw^{r]k), or ipkiVk) = Wfctanh(?7fc). 




(a) P*(n) (b) H = VP(r,) (=: ^{r))) (c) P{ri) 

Fig. 3. Relation between the ^ow cost function P*(^), the coupling nonlinearity, here V'(^) ~ ^Piv) tanh(r;), and the coupling 
function integral P(rj). Note that the image of the coupling nonlinearity ^p{ri), i.e., (—1, 1), corresponds to the effective domain of P*(n). 



The new Assumption 5.3 replaces our previous Assumption 4.6 where we required the functions Pk{j]k) 
to be strongly convex. In fact, the functions Pkiilk) now have the property that they asymptotically approach 
an affine function, see e.g., [|2|| for an explanation. Thus, they are convex, but no longer strongly convex. 
A graphical illustration of the flow cost function P^(/ifc), the coupling nonlinearity 'ipkiVk) = tanh(r7fc) 
and the convex conjugate PkiVk) is provided in Figure |3] Note that if the coupling function does not reach 
the limit, such as tpkiVk) = Wkta.nh.{r]k), its image is the open set {—Wk,Wk). 

The dynamical network counterpart to the constrained network flow problems ( |QFP3[ ), ( |QPP3[ ) is 
therefore the dynamical network ( [TT] ), ([19]) with bounded coupling functions. Now, in the same way as the 
flow constraints caused a clustering of the node potentials in the static network optimization framework, 
the bounded coupling functions cause a clustering, or partial output agreement, of the dynamical network. 



Definition 5.4: A network of dynamical systems is said to be clustering, or reaching partial output 
agreement, if there is a partition of the node set P = {Pi, . . . , Pp}, (1 < p < |V|), s.t. 



Um yi{t) — )■ (3i for all i ePi 

t— >oo 



for some /3i eM. with (3i ^ (3q for I ^ q. 



The asymptotic behavior of the dynamical network (11), (19) with bounded coupling functions can 



now be connected to the network flow problems ( |QFP3[ ), ( |QPP3[ ). We establish this connection using the 
same line of argumentation as in the previous section, but need some additional technical details. We first 
establish the existence of a steady-state solution. 

Lemma 5.5: Let Assumptions 4.2 and 5.3 hold and let (u, |i) and (y, Q be solutions to ( |QFP3[ ) and 
( |QPP3[ ), respectively. Then, u and y are an equilibrium input/output pair for the systems (]_]_), i.e., 
ky(u) = y. 

The statement follows directly from the duality relation between ( |QFP3[ ) and ( |QPP3[ ), and the definition 
of the objective functions Ki{ui). Recall, that the inputs of the dynamical network are given by u(t) = 
—Exjj{r](t)) with rj{t) E Tl(E^). Now, if the coupling nonlinearities approach a limit, it might not be 
possible to find a vector r\ E 1Z{E^) with only finite entries that realizes the desired equilibrium input 
u = —Eijj{r[). However, we show next that one can always find a trajectory such that the equilibrium 
input is approached asymptotically. In fact, the unboundedness of r| corresponds to the clustering of the 
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dynamical network, since we have in the dynamic counterpart r/(t) = E~^y(t), while in the steady-state 

^^y ^ 0. 



Lemma 5.6: Let (u, |i) and (y, Q be solutions to ( |QFP3[ ) and ( |0PP3[ ), respectively. Then there exists 
a sequence {r{} with r{ G Tl{E^) and £ G Z+ such that 

lim (u + ^VV'(riO) 0. 



The proof of this result relies on the optimal potential problem ( |0PP2[ ), which we previously used to 
determine the steady-state of the controller variable. 

Proof: Consider the problem (|QPP2[) for some u G M'^', 



mm 

T|,V 



|E| 



|V| 



iVi 



S.t. 7]= 



V. 



k=l 



Replacing the divergence u with the corresponding flow representation u = —E/j, and inserting the 
constraint in the objective function leads to the alternative representation of the problem as 



|E| 
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k=l 



ri G n{E^ 



(28) 



Note that ( [28] ) has a finite optimal solution whenever /j, strictly satisfies all capacity constraints, that is 
/X G intjWi X • • • X W|E|}. 

Now, define a sequence {[i^} such that lim^-j^oo M-^ M-, while any vector is such that each entry 
strictly satisfies the constraints, i.e., ~Wk < \xl < Wk- Each problem has a finite optimal solution since |i' 
is strictly in the range of the coupling function VP(ri) = i/'ItI)- Mimicking the proof of Theorem 4.7 
we can show that for each the optimal solution to ( [28] ) satisfies = —Eil>{r\^), where 
From lim£_j.oo M-^ M- follows lim^^oo u, and consequently lim^^oo(u + -E'Vi/'(t1^)) — >• 0. 



-EiL'. 



We are now ready to connect the asymptotic behavior of the dynamical network ([TTj), ( fT9| ) with 
bounded coupling functions to the constrained network flow problems ( |QFP3| ), ( |QPP3[ ). A natural approach 



to analyze these dynamics is to again consider the Lyapunov analysis of Section IV-C An important 



component of the Lyapunov analysis was the use of the Bregman distance Bp{r){t),r\) as defined in ([23]) 



Unfortunately, as we discussed in Lemma 5.6 there is not necessarily a finite steady-state for the internal 
model controller, and consequently T] might have unbounded components. Thus, we cannot simply consider 
Bp(T7(t),ri) as storage function. However, we can now use the sequence {r\^}, which we constructed in 



the proof of Lemma 5.6 and consider 



Bp(77(t)) := lim Bp(r;(t), V) = lim P(r7(t)) - P(V) " VP(V)T(77(t) 



The first observation we make follows directly from Lemma [5^, namely lim^ 
we exploit the property that the functions Pk{T\k) have an affine function as an asymptote, which is 



VP(ri, 



(29) 
|l. Next, 



a consequence of Assumption ( |5.3[ ). The symmetry and the existence of an asymptote implies that 
limin, -Pfc(Tlfc) + VPfc(ri,fc)^rifc = const. Since we either have lim^^ooTlL approaches a finite value 



or diverges, we can conclude that 



lim P(ri') - VP(ri') 'ri' = c 



>CXD 



(30) 



for some constant c. From these observations, we can conclude that Bp{rj(t)) := P{r}{t)) — \Ji^r](t) — c 



is a non- negative function, with minimal value zero, which is attained as 77 (t) — )■ lim^_ 
same argumentation steps as in ( [2T[ ), we obtain that 



, T] . Using the 



B(r7(t)) = -{y{t) - yy{u{t) - u) - {u{t) - u) 



(31) 
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In contrast to the discussion of Section IV-C, we have now that in general y ^ span{l}, as the potentials 
might have a clustered structure. However, exploiting the duality between the potential and divergence 
variables, we can equivalently write 'y^(u{t) — u) = VK(u)^('u(t) — u). Here, u{t) is any feasible 
solution to ( |0FP3[ ), and u is an optimal solution. Thus, an optimality condition of ( |QFP3| ) is that 



VK(u)^(w(t) -u) > 0. 
We are now ready to prove the convergence of the dynamical system. 



(32) 



Theorem 5.7: Let Assumptions 4.2 and 5.3 hold and let (u, ji) and {y,Q be solutions to ( |QFP3| ) and 
( |0PP3[ ), respectively. Then, Mmt^oo y{t) — ^ y and limt^.oo {—EW{r]{t))) — )■ u. 

Proof: Consider the nonnegative function W{x{t),r]{t)) = S{x(t)) + 'Bp(r](t)) with S{x(t)) : = 
X]l=i Si{xi{t)) the storage functions of the systems with respect to the equilibrium inputs u. Using ([8]), 
( |3T1 ), and (|32]), we directly obtain 



W{x{t),ri{t))<- 



|V| 



(33) 



i=l 



Integrating both sides and applying Barbalat's Lemma [|28ll , we finally conclude limt_i.oo uii) Y- This 
can only hold if hm^^oo u{t) — )■ u, and thus \imt^oo{EVP{r){t)) + u)) — )■ 0. ■ 
Summarizing, the clustering of diffusively coupled networks of passive dynamical systems, caused 
by bounded coupling nonlinearities, can be understood by studying a constrained network flow problem 
( |QFP3[ ). In fact, the asymptotic clustering of the dynamical systems' outputs is equivalent to the clustering 
of the node potentials in the problem (|QPP3[). 



VI. Application: Analysis of a Traffic Dynamics Model 

The presented results have practical implications. In particular, they provide a framework to analyze 
cooperative dynamical networks, since network flow optimization problems can be solved efficiently using 
numerical methods. 

We discuss here how this methodology can be used for the analysis of a traffic dynamics model. We 
consider in the following a microscopic traffic model, and focus on the optimal velocity model proposed 
in [|34ll . [|35l . We consider some modifications of the original model: (i) the drivers are heterogeneous and 
have different "preferred" velocities, (ii) the influence between cars is bi-directional, and (iii) vehicles can 
overtake other vehicles directly. The model is as follows. Each vehicle adjusts its velocity Vi according 
to the control 

Vi = k,[V,{/\y>) - Vil (34) 
where the adjustment Vj(Ap) depends on the relative position to other vehicles, i.e., Ap, as 

y,(Ap) = + Vl Yl tanh(p, - p,). (35) 

Here pi denotes the position of vehicle i, and M{i) is used to denote the neighboring vehicles influencing 
vehicle i. Throughout this example, we assume that the set of neighbors to a vehicle is fixed according 
to the initial traffic configuration and does not change over time. The constants are "preferred 
velocities" and V^^ are sensitivities of the drivers. In the following we assume V^, Vl > and V^^ ^ Vj 
(heterogeneity). 

We can now provide an interpretation of this traffic model in the context of network theory. The node 
dynamics can be directly identified as Vi{t) = Ki[—Vi(t) + V^^ + Vj^Ui{t)], with Vi{t) as node state and 
input Ui{t) := YjjeM{i) tanh(pj(t) —pi{t)). Choosing simply the output yi{t) = Vi{t), we obtain an OSEIP 
system with the affine equilibrium input-output map fcy ^(uj) = + V^^Ui. The potential variables are 
therefore the velocities of the vehicles, i.e., u^, while the divergence at a node, i.e., vehicle, is the influence 
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of the other vehicles, i.e., J2jeAf{i) tanh(pj — pi). The objective functions, which determine the equilibrium, 
are here the quadratic functions 

K,in,) = + V,% and KHy,) = ^{y, - V,')'. (36) 

The state of the coupling controller can be readily identified as the relative position of the vehicles, i.e., 
r}{t) := Ap(t), while the controller output is /ifc(t) = taiah{r\k{t)) = tanh(pj(t) — Pi{t)). This gives 
us also the interpretation of the tensions as the relative positions of the vehicles and the flows as their 
mapping through the coupling functions. The problem corresponds to a network flow problem with unity 
capacity constraints on the edges, i.e., — 1 < |lfe < 1. With this model, the problem ( |0PP3| ) takes the form 



|V| |E| 

Note that this problem has a very characteristic structure, i.e., it is a quadratic problem plus an additional 
Li term penalizing the tensions ^. Remarkably, convex optimization problems of this structure can be 
solved very efficiently using modem optimization algorithms. 

To complete the picture, we consider also the optimization problems associated to the controller level. 
The cost function on the edges for ( |0PP2[ ) are the integral of the coupling functions, i.e.. 



Pfc(rifc) = Incosh(rifc), (38) 
and the flow cost function Pl{\ik) is the corresponding convex conjugate. 



The coupling functions are here such that Assumption 5.3 is satisfied. Therefore, Theorem 5.2 holds. 



and we can use the static network optimization problems to analyze the asymptotic behavior of the system. 



In particular, the potential problem ( [37| ) has nice a convex structure and can be solved efficiently by a 
variety of numerical algorithms. 

Since the coupling functions are saturated, the model will show for certain configurations (i.e., for 
certain choices of V^, Vl) a clustering behavior. Here, clustering means that the vehicles will form groups 
that travel with the same velocity, while the different groups have different velocities. Such a behavior 
can clearly be expected in a traffic system. A computational study with 100 vehicles placed on a line 
graph is shown in Figure [4j The sensitivity parameter is k = 0.6 for all vehicles, while the parameters 
and are chosen as a common nominal parameter plus a random component, i.e., = V^^^ + V^j°rand- 
The common off-set is V^q^ = 25^ and Vi = lOy. The random component is chosen according to a 
zero mean normal distribution with different standard deviations. In Figure |4] (left), the time-trajectories 
of the velocities Vi are shown with the random coefficients ^"^and' ^i'rand chosen from a distribution with 
(T° = 2.5 and = 1, respectively. Figure |4] (right) shows the asymptotic velocity distribution of the 
traffic for different choices of the standard deviation a^. While for cr° = 1 the traffic agrees on a common 
velocity, already for = 2.5 a clustering structure of the network can be seen. The clustering structure 
becomes more refined for cr° = 4. We have chosen for all studies = 1. 

Please note that the novel network theoretic framework provides us with efficient tools to analyze this 
non-trivial dynamic behavior. 



VII. Conclusions 

We have established in this paper an explicit connection between passivity-based cooperative control 
and the general network theory framework of Rockafellar [2]. We considered a class of dynamical 
systems, satisfying a specific passivity property, i.e., output strictly equilibrium independent passivity, 
and interconnected them using a canonical network control structure. In a first step, we have shown that 
the purely structural constraint on the inputs, induced by the coupling structure, leads to a connection 
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Fig. 4. Simulation results for a traffic flow model with 100 vehicles placed on a line graph. Left: Time trajectories of the velocities for 
normally distributed coefficients with ct" — 2.5 and — 1. Right: Asymptotic velocities predicted by the network optimization problems 
for (T° = 1 (blue, '□'), a° = 2.5 (red, 'o'), and a" = 4 (green, 'A'). 



of the dynamical systems framework with a primal/dual pair of network optimization problems. The two 
problems, i.e., the optimal flow and the optimal potential problem, provided us with a duality relation 
between the inputs, which we interpret as divergences, and the outputs, which we interpret as potentials. 
In a second step, we considered a particular internal-model based control structure, and connected the 
controller states as well as the controller outputs again to a primal/dual pair of network variables, i.e., 
tensions and flows. We provide in this paper for all signals in the dynamical network a static counterpart 
in the network theory framework of [2]. 

As a main advantage, this novel interpretation allows us to directly analyze more complex problem 
configurations. We studied in this paper the output agreement problem with saturated couplings. To 
analyze this problem, we used an alternative network optimization problem, which is in between the 
optimal flow and the optimal potential problem, i.e., the saddle -point problem. Studying this problem 
revealed that constraints on the flows lead to a clustering of the potential variables. 

We believe that the connection established in this paper contributes to a unified understanding of 
networked dynamical systems and opens the way for further advanced analysis methods. 
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